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SUMMARY 


Some  specific  comparisons  are  made  in  this  note  between  the  use 
of  the  asymptotic  Chi-square  distribution  of  the  likelihood  ratio  and 
the  asymptotic  normality  of  the  maximum  likelihood  estimates  to  obtain 
confidence  interval  for  reliabilities  of  arbitrary  systems  when  only 
failure  data  on  the  components  is  known.  In  all  the  comparisons  made, 
using  moderate  samples  and  systems  of  average  complexity,  the  asymptotic 
Chi-square  appears  to  give  much  more  accurate  confidence  intervals.  Al¬ 
though  the  asymptotic  Chi-square  method  requires  machine  computation  for 
all  but  the  simplest  systems  while  the  asymptotic  normal  method  can  be 
done  easily  by  desk  calculater,  these  examples  would  indicate  the  Chi- 
square  method  would  be  superior  in  most  practical  instances. 


1.  INTRODUCTION 


In  a  recent  publication  [2],  Madansky  has  shown  how  to  use  the 
asymptotic  distribution  of  the  logarithm  of  the  likelihood  ratio  to 
obtain  approximate  confidence  intervals  for  series,  parallel  and  series- 
parallel  systems.  That  this  method  could  be  extended  to  the  class  of 
systems  which  are  monotone  was  shown  by  Saunders  and  Myhre  [6].  In 
this  study  we  make  some  comparisons  between  this  likelihood  ratio  method 
and  the  only  other  method  presently  known  which  can  be  used  to  obtain 
approximate  confidence  limits  for  the  reliability  of  an  arbitrary  system. 

This  alternate  method  was  proposed  by  Rosenblatt  in  [5]  as  a  special  case 
of  the  U-statistic  which  was  discussed  in  that  paper.  But  this  method 
also  depends  upon  the  asymptotic  distribution  of  the  statistic  used  and 
hence  is  also  approximate  in  the  same  sense  for  finite  sample  size. 

We  can  help  to  answer  the  question  of  which  approximation  is  best 
by  finding  a  situation  in  which  exact  confidence  intervals  can  be  found 
by  other  means  and  then  making  a  comparison  between  the  two.  We  also 
might  ask  which  statistic  has  its  distribution,  for  certain  moderate  sample 
sizes  likely  to  arise  in  practice,  closer  to  its  asymptotic  distribution. 

<*v«, 

We  do  both  of  these  things  believing  that  these  answers,  foi^ finite  sam¬ 
ples,  help  resolve,  much  more  effectively,  the  question  of  which  method  is 
better  than  the  answer  to  the  question  of  which  test,  the  inversion  of  which 
gives  the  approximate  confidence  interval,  has  the  highest  asymptotic  relative 


efficiency. 
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Let  y  ,  a  Bernoulli  random  variable,  be  the  indicator  of  performance 

for  the  ith  component  among  m.  The  state  of  the  components  then  is  the 

vector  y  -  (y. , . . .  ,y  ) .  By  a  monotone  structure  we  follow  [1]  to  mean 
J-  m 

there  exists  a  non-decreasing  Boolean  function  $  of  the  state  of  the  com¬ 
ponents,  <}>(y),  which  is  the  indicator  of  the  state  of  the  structure.  If 
Ey^  ■  p^  for  i  *  l,...,m  is  the  reliability  of  the  i*"*1  component,  then 

the  components  reliability  is  the  vector  p  =  (p-,...,p  )  and  E<Hy)  =  h(p) 

1  m 

is  the  reliability  of  the  structure. 

Our  data  consists  of  the  vectors  x  =  (x,  ,...,x  )  and  n  =  (n,,...,n  ) 

I  m  I  m 

til 

where  we  have  observed  x^  successes  in  n^  trials  of  the  iu  component. 
The  number  of  successes  x^  has  a  binomial  distribution. 


2.  THE  LIKELIHOOD  RATIO  METHOD 


Let  us  summarize  the  likelihood  ratio  (LR)  method  presented  in  [6], 

Let  a  monotone  system  reliability  function  h  of  order  m  and  data  (x,n) 
be  given.  Now  we  define  a  function  A  from  the  m-dimensional  unit  hyper¬ 
cube  into  the  same  space  for  each  given  real  6  by  the  equation  for  its 


th  , 
j  coordinate 


(2.1) 


x.-fip  ,<5  ,h(p) 

A  (p , 6 )  =  1  x  *p  u/  \ 

j  n^-Sp^djhCp) 


j  —  1 , . . . ,m. 


where  6^h(p)  represents  the  partial  ^derivative  of  h  with  respect  to 


th 


the  j  coordinate. 

For  given  p°  in  the  domain  of  A  we  set 


p^Cd)  *  A(pi  1 ( 5 )  , 5) 


i  =  1,2, . . . ,  . 


Call  the  limit  which  exists  p*(6),  which  is  a  fixed  point  of  A. 
Then  one  computes  hp*(6)  where  we  make  here  and  throughout  the  conven¬ 
tion  that  juxtaposition  of  functions  denotes  composition. 

Now  let  the  maximum  likelihood  estimate  of  component  reliability  be 
given  by  p^  =  x^/n^  for  i  a  l,...,m  and  set 

m 

(2.2)  N(p)  -  ^  n  [p^n  p  +  (1-p  )  £n(l-p  )  ] . 

i=l  1  1 

Then  we  also  must  compute  —A ( 6)  where 

(2.3)  A ( 6)  =  Np*(6)  -  N(p) . 

A  confidence  interval  of  level  y  can  be  obtained  from  the  set 

(2.4)  A^  =  {6:  —A (6)  <  (1)>, 

2  th 

where  (1)  is  the  y  quantile  of  the  Chi-square  with  one  degree  of 

freedom  distribution,  by  taking 

(2.5)  {hp*(6)  :  6  e  Ay}. 

That  this  method  gives  an  approximate  confidence  interval  is  the  substance 
of  [6]. 

A  program  which  performs  these  calculations  automatically  and  which 
requires  only  the  inputs 

1°  the  reliability  function  h 

2°  the  data  on  component  performance  (x,n) 

3° 


the  desired  confidence  level  y 


I 
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to  obtain  the  boundary  points  of  the  interval  given  in  (2.4)  is  available 
by  request  from  the  authors. 

To  make  the  ideas  clear  we  illustrate  with  a  simple  example.  Let  us 
consider  the  "2  out  of  3"  quorum  structure  reliability  function 

b(p)  -  P3U  “  (l-p1)  (l-p2)]  +  (l-p3)p1p2. 

If 

(2.6)  x1  =  7,  x2  -  8,  x3  »  9  and  n!  =  n2  =  n3  “  10 
then  h(p)  *  .902. 

We  give  in  Figure  1  the  graphs  of  hp(6)  and  -A(6)  as  functions  of  6. 


The  abcissa  contains  values  of  6.  Cn  the  left  ordinate 

2 

are  plotted  values  of  y  such  that  x^_^(l)  =  —2 A ( 6 ) 
and  on  the  right  ordinate  are  the  values  of  hp(6). 
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\ 

The  data  summarized  in  this  graph  was  obtained  by  a  program  (which  is 
also  available  by  request  from  the  authors) .  This  program  is  the  basis 
of  the  one  mentioned  previously  and  uses  only  the  inputs  h  and  data 
(x,n)  in  the  following  manner:  Take  a  sequence  of  values,  say,  6^  =  i 
for  i  «  0,  ±1,  ±2,...  over  a  sufficiently  large  range,  here  taken  as 
i  »  “100,..., 20.  Beginning  with  6  ■  0,  p*(0)  =  p,  we  solve  for  p* ( 6 ^ ) 
by  using  as  the  initial  estimate  the  solution  of  the  previous  iteration. 

Let  =  p*(<5^)  and  have  the  computer  obtain  the  iterates 

p^(6^+^)  -*■  p*(6^+^).  We  can  then  compute  hp*(6^),  -A(6^)  at  each  value 

of  i.  For  a  given  6  we  plot  the  values  of  hp*(6)  on  the  right  ordi¬ 
nate  and  the  Chi-square  value  corresponding  to  -A (5)  on  the  left  ordinate. 

To  obtain  a  confidence  interval  we  follow  the  analogous  procedure  for 
the  function  which  we  now  give  for  the  graphs.  We  select  a  value  of  the 
confidence  level  y  on  the  left  ordinate,  then  we  find  the  two  values  of 
6  on  the  abscissa  for  which  -A (6)  assumes  that  value.  We  then  read  the 
two  corresponding  values  of  hp(6)  on  the  right  ordinate  and  these  values 
are  the  confidence  intervals. 

We  see  by  examining  (2.1)  at  the  unique  fixed  point  p* (5)  of  A(*,6)> 
which  is  the  function  of  the  sample  data  (x,n),  that  this  point  satisfies 
for  any  positive  integer  w  the  equation 

(2.7)  p* ( 6 :  u)x,um)  **  p*(5/co:  x,n). 

Accordingly,  from  (2.2)  we  have 


N(p:  ojx.wn)  ■  wN(p:  x,n). 
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Hence  from  (2.3)  it  follows  that 

(2.8)  A ( 6 s  cox, con)  ■  coA ( 5/co :  x,n). 

These  two  relations  make  possible  an  instructive  comparison  of  the  de¬ 
creasing  length  of  the  confidence  interval  with  increasing  sample  size. 

If  we  take  the  same  data  as  given  in  (2.6)  and  set  to  =  10  and  use 
the  relation  (2.7),  (2.8),  we  have  Figure  2  as  the  graphical  solution. 


Figure  2 


The  abcissa  contains  values  of  6.  On  the  left  ordinate 

2 

are  plotted  values  of  y  such  that  *  — 2 A ( 6 ) 

and  on  the  right  ordinate  are  the  values  of  hp ( 6) . 
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If  we  take  w  *  100,  we  obtain  Figure  3. 


Figure  3 

The  abcissa  contains  values  of  6.  On  the  left  ordinate 

2 

are  plotted  values  of  y  such  that  X  ^  ^(1)  *  — 2A ( 6 ) 
and  on  the  right  ordinate  are  the  values  of  hp(6). 


safe" 

qj " 


Let  us  now  consider 


reliability  system 


1-Pj  we  write 


a  more  realistic  case  where  we  have  a  "fail 
(an  m-1  out  of  m  quorum  structure),  letting 


(2.9) 


h(p)  -  T~[?± 

i-1 


'•  V/' 


-8- 


Consider  the  data  for  m  ■  10,  n^  ■•••■  n^  *  100 

x1  -  87,  x2  -  86,  x3  -  82,  x4  =  89,  x$  *  98 

(2.10) 

x6  -  95,  x?  -  97,  x8  -  96,  xg  -  91,  x1Q*  96. 

Now  h(p)  ■  .803.  Using  the  iteration  method  just  described  we  obtain 
for  6  ■  -500, (15) ,100  the  values  of  hp(6)  and  —A ( 6 )  given  in 

Figure  4.  In  particular,  for  y  *  .95  we  have  the  interval  (.72,. 88) 

for  the  true  reliability  h(ir) . 


-.94 


-.70 


-500  -400  -300  -  200  -100  0  100 

Figure  4 


The  abcissa  contains  values  of  6.  On  the  left  ordinate 

2 

are  plotted  values  of  y  such  that  X^_y(D  =  — 2 A ( 6) 
and  on  the  right  ordinate  are  the  values  of  hp(6). 


-9- 


3.  THE  MAXIMUM  LIKELIHOOD  METHOD 


If  yi(j)  for  j  =  are  the  Bernoullian  random  variables 

which  represent  the  data  on  the  behavior  of  the  i^  component  then  in 

terms  of  our  previous  notation  x^  =  y ^ (1)  +  •••  +  y^(n^)  Is  fhe  total 

t  h 

number  of  successes  for  the  n^  trials  of  the  l  component.  In  [5] 
it  is  noted  that 


^m  4>Iy1(i)....,ym(j)] 

U  =  /  _  /. 

j-1 


i*l 


n*H 

k-1  1 


h(p)  . 


Now  an  alternate  method  of  obtaining  approximate  confidence  intervals 
can  be  based  on  either  the  well  known  asymptotic  normality  of  maximum  like¬ 
lihood  estimates  or  equivalently  in  this  case  the  asymptotic  normality  of 
U-statistics.  This  method  was  called  "linearization"  by  Madansky  in  the 
comparisons  which  he  made  in  his  paper  loc.  cit. 


We  now  state  the  appropriate 


THEOREM:  If  p  is  the  maximum  likelihood  estimator  of  the  true 
component  reliability  vector  ttj  then  h(p)  is  asymptotically  normal 
with  mean  h(v)  and  variance 

m 


=  S[: 

3=1  L 


3  .h( n) 
3 


2var( p  .) . 

t) 


Proof :  See  Rao  [p.207,  4]. 

Using  this  result,  approximate  confidence  limits  of  level  y  for 

t  h 

h (tt)  can  be  obtained  from  h(p)  ±  z  ^  1— y)  / 2  * ^  w^ere  Zy  fs  Y  percen 
tile  of  the  standard  normal  distribution.  For  the  structure  given  in  (2.9) 


one 


calculates 


3>(p)  -  TTPi  /I  7^  m 

1  1  pi / 

So 

(3.1) 

Calculation  with  a  desk  computer  for  the  data  in  (2J.0)  using  (3.1)  with 
m  *  10  yields 

h(p)  =  .803  a2  =  .001047. 

By  choosing  z  ^5  =  1*960  the  95%  confidence  interval  becomes  (.740,. 866) 
which  is  noticeably  different  from  the  one  obtained  previously.  The  latter 
interval  is  shorter  on  each  side  by  about  .02. 

To  make  another  comparison,  take  the  data  given  in  (2.6)  and  we  cal¬ 
culate  by  desk  computer  using  (3.1)  with  m  **  3,  h(p)  =  .902,  6  =  /. 00449. 
Now  we  take  y  *  .90  and  the  confidence  interval  becomes  (.79,1.01)  which 
can  be  compared  to  the  interval  (.74,. 97)  generated  by  the  likelihood  ratio 
method.  Again  the  intervals  differ  significantly. 

As  before  we  ask  what  happens  to  the  ML  confidence  interval  for  the 
data  (wx,ojn)  and  we  notice  that  h(p)  remains  unchanged  but,  by  (3.1) 
that  o(a3X,u)n)  —  o(x,n)  /  JZ  . 

Using  the  data  (2.6)  in  the  2  out  3  system  and  the  numerical  results 
of  which  graph  1  is  a  summary  we  obtain  for  a  90%  confidence  interval 
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LR  ML 

a)  =  1  (.74, .97)  (.79,1.01) 

w  -  10  (.862, .932)  (.867, .937) 

Of  course,  the  above  calculations  show  the  comparative  simplicity  of  the 
ML  method  and  it  also  shows  that  in  cases  when  sample  sizes  are  of  the 
order  of  100  observations  for  each  component,  (impracticably  high  in  most 
situtations) ,  and  the  reliability  estimates  not  too  close  to  one,  that  both 
the  ML  and  LR  methods  will  yield  essentially  the  same  confidence  intervals 
for  simple  enough  structures. 

As  the  structure  becomes  more  complex,  however,  the  number  of  obser¬ 
vations  for  each  component  must  increase  to  obtain  the  same  limits  by  the 
two  methods  as  we  saw  with  the  structure  (2.9). 

m 

To  see  how  this  works  consider  the  series  system  h(p)  =  ~|  fp  .  Since 

1  1 

p^  =  x^/n^,  if  n^  =  n^  and  for  i*l,...,m  then  for  n  =  5 

and  m  =  10,  by  the  rapidity  of  convergence  in  the  central  limit  theorem 
when  the  summands  are  identically  distributed,  the  distribution  of  h(p) 
is  very  close  to  log-normality.  To  make  the  distribution  close  to  normal, 
we  have  to  take  n^  at  least  100.  While  if  m  =  2,  then  n^  =  25  may 
be  enough  to  have  h(p)  close  to  normality.  If  m  =  25,  no  sample  size 
n^  of  practically  attainable  magnitude  might  be  large  enough  to  do  the  trick. 

A  weakness  of  the  ML  method  is  that  the  confidence  limits  are  always 
symmetric  about  the  estimate  of  the  reliability  and  when  this  estimate  is 
near  one  and  the  sample  sizes  moderate,  both  of  which  occur  frequently  in 
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practice,  it  may  give  intervals  in  which  the  upper  limit  exceeds  one. 

Of  course  this  objection  is  partially  vitiated  in  case  interest  is  con¬ 
fined  to  lower  confidence  intervals. 

4.  COMPARISON  WITH  EXACT  CONFIDENCE  INTERVALS 

Actually  comparisons  between  the  actual  confidence  intervals  given 
by  the  ML  and  LR  methods  are  not  too  meaningful  when  they  do  not  agree 
since  in  general  there  is  not  a  unique  exact  confidence  interval  to  which 
they  can  be  compared.  However,  there  do  exist  special  cases  for  which  we 
can  obtain  exact  confidence  intervals. 

If  all  component  reliabilities  were  known  to  be  equal  in  a  k  out 
of  m  quorum  structure,  the  system  reliability  would  be  [p.20,  Ref.  1], 
(here  letting  p^  be  the  common  value  of  the  vector  (p^,...,p^)  and 
disregarding  our  previous  notation  that  h  map  the  unit  hypercube  into 
the  unit  interval) 

m 

(4.1)  h(Pl)  = 

Using  the  notation  for  the  incomplete  beta  function  found  in  the  tabulation 
by  Karl  Pearson  [3] 

we  have 


(4.2) 


h(pj^)  =  I(p1;k,m-k+l) . 
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I:  The  exact  method. 

If  we  denote  =  x^/n^,  then  we  obtain  a  100y%  upper  limit 
p^  as  the  solution  for  the  real  variable  p^  such  that 


E 

j=0 


n1  .  n  -j 

j  p^q  ■  l  -  i(p1;x1+i,n1-x1+i)  =  -jL 


and  a  lower  limit  as  the  solution  for  the  real  variable  p^  such 

that 


n 


1  1  nl~-^  1- 

0l  Plql  *  ^P1  :Xl’ni~Xl+^  = 


E? 

j-x 


which  can  be  solved  using  Pearson's  tables  loc.cit.  So  we  have  with 
confidence  y 

%  <  *1  <  Pl’ 

and  hence 


h(jg^)  <  h  (  tt  ^)  <  h(p1> 

is  an  exact  confidence  interval  of  level  y  for  the  true  system  reliability. 

Assuming  tt  *  (ir  ,...fu^)  for  the  structure  given  in  (4.1),  and  that 
x^  =  23,  n^  =  25  and  interpolating  linearly  in  Pearson's  tables  loc.  cit. 
we  obtain  the  95%  confidence  limits  for 

p^  =  .976  2^  =  .740 

Fixing  m  =  10,  and  transforming  this  interval  by  the  function  defined 
in  (4.2)  we  have  exact  upper  and  lower  tolerance  limits  as  given  in  I 
table  1,  (page  15). 


T 
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II.  The  ML  Method 


By  the  theorem  we  have  for  a  k  out  of  m  structure  with  ■  (p  ,...,pj) 


that 


o,  *  k 
k 


/m\  k-1  m-k  /^lql 
(k)Pl  ql  *  — 


and  substituting  ■  x^/n^  for  we  obtain  an  approximate  100y%  con¬ 

fidence  interval  of  the  form 


I (Px :  k.m-k+1)  ±  ok  • 

Using  n^  ■  25,  x^  *  23,  m  ■  10  and  y  *  .95  with  the  fact  that 

*  (m-k)p^/kq  we  obtain  the  following  95%  confidence  intervals  for 
h(ir^)  as  given  in  II  table  1,  (page  15) 

III.  The  LR  Method 


In  this  one  dimensional  case  the  LR  method  yields  a  simple  procedure 
for  obtaining  an  approximate  confidence  interval  for  h ( tt ^ )  of  level  y. 
Now  the  transformation  A  is  from  the  unit  interval  into  the  unit  interval 
and  thus 

N(p1)  =  xl  In  +  (n^-x^  lnCl-p^ 

so  that  instead  of  using  the  parameter  5  we  can  as  well  use  p*(6).  We 
then  have 

=  (px :  NCp1>  -  1  NCp^} 


and  the  confidence  interval  becomes 
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(h^)  :  l  A^  } . 

Using  the  data  n^  =  25,  x^  =  23,  m  =  10,  y  =  .95  we  have 

A^  =  (.773,  .986) 

Again  by  transforming  this  interval  by  the  function  h(p^)  as  defined 
in  (4.2)  we  obtain  the  LR  confidence  intervals  as  given  in  III  Table  1. 


TABLE  I 


Exact 

ML 

LR 

k 

I 

II 

III 

10 

(.049, .787) 

(-  070,  .938) 

(.076, .871) 

9 

(.221, .977) 

(.418,  1.21) 

(. 2997, .9912) 

8 

(.495, .9984) 

(.823,  1.097) 

(.595, .9996) 

7 

(.7511, .99993) 

(.9664,  1.022) 

(.8266, .99994) 

Comparison  of  95%  confidence  intervals  for  k  out  of  10  quorum 
systems  with  identical  component  reliabilities. 
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Of  course  no  one  in  his  right  mind  would  use  such  a  procedure  as 
II  or  III  in  this  case  but  in  real  situations  these  conditions  might 
be  approximated. 

This  evidence  would  lead  one  to  suspect  that  for  all  structures 
in  which  the  true  reliabilities  are  nearly  the  same  and  near  one,  and 
the  number  of  observations  for  each  component  small  but  the  structure 
not  simple  (in  short,  those  cases  which  are  usually  encountered  in 
practice)  that  the  LR  method  would  yield  results  which  are  superior. 
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We  now  make  some  comparisons  with  a  few  selected  cases  in  the 
tables  of  exact  confidence  limits  for  systems  which  are  available. 
These  are  for  series  systems  of  order  two  and  three  with  the  same 
numbers  of  observations  taken  for  each  component. 

We  shall  use  the  tables  of  Lipow  and  Riley  [2]  which  we  shall 
denote  by  RL.  These  tables  provide  directly  upper  bounds  on  the 
unreliability  but  by  taking  the  entries  and  subtracting  for  one 
unity  we  obtain  lower  bounds  on  the  reliability  which  we  use  for  our 
comparisons. 

Based  on  the  LR  method,  utilizing  our  previous  notation,  a  lower 
confidence  bound  on  the  true  reliability  of  level  (1  +  y)/2  is 

hp(S*)  where  6+  =  sup  >  0.  (The  true  confidence  level  used  for 

the  comparisons  of  one  sided  confidence  bounds  in  [3]  for  the  LR 
method  was  not  correct.  The  three  upper  limits  were  compared  for 
n^  =  n£  *  100  when  the  number  of  failures  was  3  and  5  respectively. 

At  a  90%  confidence  level  the  upper  limits  are 

Buehler's  value  =  .00412 

LR  =  .00349  (not  .00518  as  given) 

ML  =  .00164 

the  .00518  value  corresponds  to  a  97.5%  confidence  level.)  Similarly 

a  lower  confidence  bound  on  the  true  reliability  of  level  y  is 

h(p)  +  z,  • d  when  based  on  the  ML  method.  Again  here  z  is  the 
v  1-Y  Y 

t  h 

y  percentile  of  the  standard  normal  distribution. 

Selecting  typical  entries  which  might  arise  in  practice  from 
volume  I  of  reference  [2]  we  have  the  comparisons  of  table  II. 
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TABLE'  II 


k 

h(p)  -  TT  P±  n±  -  xi  -  y±9  ni  "  no  for  1  *  1»***  k 


Confidence  Level 


The  values  for  the  lower  confidence  bound  obtained  by  the  LR 
method  for  N  >  200  which  we  computed  did  not  differ  by  more  than 
.002  from  those  tabled  in  volume  II  ref  [2],  while  the  ML  bounds 
differed  by  about  twice  this  amount.  This  small  discrepancy  was 
not  thought  sufficient  to  display.  We  point  out  that  at  every  in¬ 
stance  in  table  II,  the  LR  method  lies  closer  to  the  RL  value  than 
does  the  ML  bound. 


5.  THE  EMPIRIC  DISTRIBUTION  OF  THE  TOO  STATISTICS 

The  question  about  which  of  the  LR  or  ML  methods  is  the  better 
in  a  given  instance  can  only  be  answered  by  knowing  whether  the  dis¬ 
tribution  of  h(p)  is  closer  to  normality,  than  -2A(6^)  is  "loser 
to  a  Chi-square  distribution  where  6^  is  that  argument  of  p*(6) 

such  that  hp*(6)  -  h (it)  .  .  More  precisely,  for  a  given  h,  tt  and 

2 

n,  is  the  distribution  law  of  [  (h(p)  — h  (tt)  ]/o]  or  -2A(6^)  closer 

to  a  Chi-square  with  one  degree  of  freedom.  In  this  form,  the  question 

can  be  answered  by  simulation  with  a  computer. 

Select  a  monotone  reliability  function  h  of  certain  order  m, 

the  vector  of  true  reliabilities  tt  *  (tt,  ,...,ir  )  and  the  set  of  sample 

j.  m 

sizes  n  =  (n, , . . . ,n  ) .  We  now  generate  the  binomial  observations 
1  m 

x  =  (x^,...,xm)  where  each  x^  is  binomial  with  parameters  tt^,^. 

We  now  compute  p,  h ( tt)  ,  h(p)  and 


,2 

o 


m 

j«i  2 


h(p>]  P^/Hj 


and  then  calculate 
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X  -  [  (h(p)-h(Tr) /a] 2 . 

We  also  use  the  operator  A  to  calculate  p*(6  )  with  5  such  that 

TT  7T 

hp* ( <5 ^ )  =  h (tt)  ,  and  then 

Y  *  -2A(6tt)  =  2N(p)  -  2NP*(6tt) 
where  N  was  defined  in  (2.2). 

All  of  the  above  steps  are  repeated  to  obtain  a  set  of  observations 
(Xi ,Y^)  for  1=1,..., K 

where  K  is  in  the  thousands,  and  the  frequency  histograms  and  the 

2 

empiric  cumulative  are  compared  with  x  (1)  distribution. 

The  results  of  two  comparisons  are  now  given:  Figure  5  shows  how 
much  closer  the  true  distribution  of  Y  is  to  Chi-square  with  one  de¬ 
gree  of  freedom  than  X  is  when  only  10  observations  for  each  component 
are  used.  Figure  6  shows  that  for  20  observations  both  distributions 
lie  closer  but,  especially  in  the  tail,  the  distribution  of  Y  is 
closer  to  its  asymptotic  distribution. 


2  4  6  8  10 

Figure  5 


The  empiric  distributions  of  X,  using  the  ML  method, 
and  of  Y  using  the  LR  method  based  on  2000  observa¬ 
tions  and  compared  with  their  asymptotic  distribution 
for 

nl  =  n2  =  n3  =  10,  TT^  ==  7T2  =  7T^  =  .7 
h (p)  -  P3 [1— (1-P1) (1"P2)  1  +  (1-P3)P1P2 


I 


Figure  6 

The  empiric  distributions  of  X,  using  the  ML  method, 
and  of  Y  using  the  LR  method  based  on  2000  observa¬ 
tions  and  compared  with  their  asymptotic  distribution 
for 

nl  =  n2  =  n3  =  20,  =  v2  =  *3  =  *7 

h (p)  -  p3[l-(l-p1)  (1— P2) 1  +  (1"P3)P1P2 
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